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ABSTRACT 

Ninety-six 9th, 10th, and 11th grade students, 
randomly selected to Include equal numbers from each grade level, 
from both sexes, and from each ability quartile were randomly 
a^sgfgTiQd to either experimental or control procedures. The^ 
e X pe E i in e n ta 1 qroup used the computer to select courses, while the 
control group was assisted by the counselor. Three criterion 
measures, used to assess the relative effectiveness of the 
computer-based system, are described^ (1) a test of student's 
understanding of information relevant to course selection; (2) 
students* self-reported reaction to either the computer or the 
counselor; and (3) a rating of the completed student programs by 5 
counselors. No significant differeiices are reported. The author 
acknowledges the impossibility of concluding, from this study, that 
counselors are more effective than computers in assisting students in 
the exploration and selection of courses. (Author/TL) 
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A Comparison, of the Effectiveness of a Computer-based 
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Abstract 

The 1‘indirigs oi a,n experimental i ua^' v/ex c ^on.s ^._i. 

el iect iveness of a coiTiputer-based counseling s 5 -^stem vrltb a couiiselor=bafaed 
system. 

puring the school year 197 ^"“ 71 5 the ninths tenths and eleventh giade 
classes at Willowbrook High School^ Villa Parkp Illinois used the computer to 
explore and select courses for the following year . Ninety- six students were 
randomly selected to include equal numbers from each gi'^ade levels from both 
sexes 5 and from each ability quartile and were randomly assigned so as to include 
equal n^s to experimental and control procedures. The experimental group useo 
the computer to selE;ct courses and the control group was assisted by the coun- 
selor in the sulection of courses. 

Three criterion measures were used to assess the relRtive effectiveness of 
the computer-based system: test of students’ under st and. i.ng of information 

relevant to course selection; students’ self-reported reaction to his experience 
v/ith the computer or counselor | and a rating of the completed student programs 
by five coimselors, 

A a lx- way repeated measures analysis of variance and a four- way completely 
crossed multivariate analysis of variance was used to interpret the data. Of 
major concern was the comparison between computer-asBlsted and counseloi- 
assisted course planning^ but the effects of subject^’ sex^ grade levels and 
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ability were also tested well as all interact i ar.-iong variab3.es. 

No significant differences were found between means of the computer- 
scheduled students and the counselor-sciieduled students ?.cro.-s all measures. 
There ’/are no treatment d,ifferences related to ability,' j ssxj arid giade ba.^-cd 
on statistical techni.ques applied to all of the measures. It is impossic].e 
to conclude from this study that counselors are more effective tlian computer 
in p.ssi st:i nja: students in the exploratinn and selection of epurses. A more 
detailed description of the measures used, data analysis and conclusions are 
presented in tliis paper. 
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C'^mputerized 
Comparison of 
Sr/sroTn 



Course Exploration and Selection-- 
tiie Ef o t i vGnfi s c of a. Cotnputsr— r.jabed 
vlth a Counseloi'-basod System 



Gary E. Price 
Michigan Slate University 



A student in high school is asked to make mnuy important decisions 
regarding the courses he selects. These decisions have a siguificaiit effect 
on later educational and occupational opportunities. In spite of their impor 
tance, many of these decisions are made on the basis of inadeq.uate or poorly 



dissemlnated infoimnation . 

Clarke, Gelatt and Le-lne (1965) pointed out at, "The decision maker 
needs adequate information, and he needs an effective strategy for analyzing, 
organizing and synthesizing that information in order to arrive at a chojce 
[p. 4l]." Insofar as pccsible, the high school administration, ins ui uct i.onal 

staff arid, in particular, the couriselor have a responsibility to disseminate 
accurate, useable and relevant information ulth v^hich students can make deci- 
sions. Clarke, Gelatt and Levine (1965) summarized the demands placed on the 



counselor when they stated: 

Greater efforts should be made to deteriTiine what specl.fic^ 
Infcrmation is relevant to the educational- vocational deci- 
sion faced by high school students, to gather and organize 
that information, and to help students learn to use it 
effectively [p. 4l], 

Some of the problems in the current course exploration and selection 



procedures consist of the shortage of time that counselors have available on 
the secondary level to assist students in the decision-making process when 
students need accurate and appropriate information for course es^loratlon and 
selection. Also, it is sometimes difficult to help students select courses that 
meet their own needs and interests because of the large number of courses that 



at-9 ^.va.l,ble ths student. Because of tirre llmttattor.s It is extrc«el.v cH f- 

fieult in the current situation for counselors to heap iip- to«(.3n. we 

the currer.t curivLculum and '.-.•hat ie available tn students; they counsel. 

The movement toward individualized instruction and the rapidly changing 
curriculum to .ceep pace with the knowledge explosion are making course selection 

increasingly difficult. To effectively assist students plan their educational 
rrogra-ms, counselors need relevant information about students and about curri- 
cular offerings. As courses and programs proliferate to meet Individual needs, 
the information demands become greater. It is quite possible that a coiputer- 
based cystem could provide more accurate Information and help students select 
courses more effectively than counselors.' If only as effective as counselors, 
the computer might, be i>referred in order to free counselors for other duties. 



Purpose 

It was the purpose of this study to explore and evaluate the effects cj. 
using a computer-ba.sed system to assist students in the exploration .and selec- 
tion of courses on the secondary Level. The following areas were considered. 

Is the computer as effective as counselors in assisting students in nne 
declsion-mak.ing process? Are the decisions made by the student regarding 
course selection in a computer-based system better than those decisions made 
by the student In a counselor-based system? Does the effectiveness of a 
computer-based system or a counselor-based system vary accovd up; tho .student’s 

grade level, the studr.it's ability or the student's sex? 

It was the purpose of this study to evaluate the use of a computer-based 
system to assist students in the exploration and selection of courses In contrast 
to a counselor-based system. A unique opportunity to evaluate the relative 
effectiveness of such a computer system was available when Willowbrook High 
School initiated such a system for three grade levels dui’ing the 1970-71 



^pj^^chool year. 
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Th^?r 0 s 0 verR.l GOiTipu1:.er*^hs.s&^d syst;r":i£ 3_n g‘u1.oRun^ Aiicl i nj, ort niai. i.on 

dis sernxnat Ion . SoniG of th^ iLore racent suinnar ics oi A, a tfe;‘ahnC'logical 
of guidance are summp.rxzed In Bailey (197^0 3 Havens (l9'70); Super (l970) , 
Computer-based Vocational Guidance Systems (19^9) 3 and Edinza^pn^ T echno^ y 

(1969). 

Of the several comnuter^- based systems tEiat are runctioning in some 
aspect of guidance, some are information storage and retrieval systems (impel--^ 
litter i, 1967 , 1968 ). Systems capable ■ f interacting with individual users 
have been developed for career exploration (Harris, I 968 ; Impelli tte-ri , 1969; 
Loughary, et al*, 1966 ; Super, I 96 B 1 and Tiodeman, 19d8)^ but there has been 
very little experiTnental research of or development of interactive computer- 
based systems to assiGt students in course selection. Many writers have indicated 
that computers could be effectively used in counseling. Cooley (l9ou) indicated 
that many of the time-consuvaing details that take large amounts of the counse- 
lor's time can now be autOTnated, One of the time consuming tasks :s collecting 
and dis tr ibut imig accurate and routine inf ormation to enable students to select 
coiirses. Roberts ( 1968 ) stated that the use of technology in guidance would 
reduce the workload, of counselors in the areas oi gathering Information, data 
analysxs and reporting. Also, the processing of data would improve because 
of clearer and more accurate communication between the counselor and counselee 
thx"u the use of technolog5^* Impellitteri (I 967 ) found a computer-based aysteiri 
to have greater flexibility and storage capacity than counselors and permitted 
more accurate up-to-date information to be available for the user. 

There has been some concern expressed related to the ’'dehumanizing” 
process of using man and machine interaction in place of human v/ith hum.an inter- 
acting, There is no evidence to suggest that individuals dislike man-machine 
interaction or that machines cannot do as effective a job as humans. 



t (19^6) inummar 1 5 :ed the reaction 



:=o their i ntei’ac t i witli 



a. coinp uteri zed vocat.ional exploration prograin Tlie 
group did not indicate rhat the interaction was any 



toys in 
problein 



t; ti 0 e xp e r i rrifni t a 1 



h a ~i nd i — 



cabed they liked x.ho privacy as£:ociated v;ith their interaction. 

There have been several advantages related to the application of the 
Ifjarning principle to a computer'-based inodel in educat5^on. oi^evart (19^7) 
tound that students benefit in the follov/ing areas v/hon using Individualized 



ins t I'uc t i o na 1 rna c h 1 ne s : 



( 1 ) Student re inf or ceri'ient 5 (^0 Student invoD^venient 5 (3) Item 
difficulty control^ (4) Speed and pattern of response, (5) Peer 
pressure reduced, ( 6 ) Incorriplete task, apprehension reduced, 

( 7 ) Culturally fair items-=three dimensional items ^ ( 8 ) Single 
item exposure, and (9) Consistency of admin ls tx^at ion [pp- 2^1" ^3 ]• 

The advantages re.’’ ted to reinforcement, student involverneint , individualized 



speed and pattern of respondirig, reduction of peer picssuxe. 



s ingle= small 



seBinents of Information and a systematic presentation are present in the com. 
puter-based program for course exploration and selection Harris (1970) 
further supported the advantages of computer- base.! programs when she stated 
that thru the use of computers and good script writing, technology had a 
positive effect as a part of the counseling program. 



If you define counseling as bringing a group of related facts 
to bear upon a given situation and thus facilitating a step- 
by-step decision-making process, computers can perform this 
function with maximum speed and efficiency. With good script- 
wi’t ting and adequate intGr-change between student and computer, 
computers can add a dimension of student involvetneni.. and 
encitmaent to self-appraisal, decision-making, vocation explo- 
ratioi: , and educational exploration seldom obtained in tradi- 
tional counseling conferences [p. I 63 I. 



^ne of the few studies directly relevant to this research was one by 



Frlesen ( 1965 ) In which he compared the similarity of outcomes between the 
computer-based counseling systems, model counselor, and a second counselor. 
The criteria included pupil appraisal statements and course selections. Th 
iiachine agreed with both human counselors on approximately 75 percent of the 
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appraisal statements and about percent the course selections. 



Fricsen 



made- three rccciumfeudatlous rc-garding futui'c studies ir. computer- nasea educa- 
tional explox'at; i,o>i j (l) Permit Etudents to explore and sclocu coui-ses it'.ai ai 
related to the ir In tores ts and personali t,v : (c) Chec.t to determine ti students 

have completed the prere'iulsites before pei'mitting them to enroll In sequential 
courses; and ( 3 ) 5 o not permit students to sign up ifor courses that are noi 
i-elated to the student's achievement and aptitude level All of ih- above 
recoiTiinendat ions v;e?re .iricluded in this study 



Methodolop; 



Iritroduct ion 
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luring the school year 1970 - 71 , the ninth, tenth, and eleventh grade 
classes of Willov/broo'i High School, Villa Part, Tll'inois used the computer 
to explore and select courses for the following year. Kinety-six students 
were randomly chosen in a ■manner to Include equal nuuibers fi’OiTi each grade 
pgy 0 P^ from both sexes, and froni each tested apti'Lude quartile and ■wore ran- 
domly ass-Lgned so as to include an equal number of subjects to experimental 
and to control procedures. The experimental group used the computer-assisted 
coui-se selection while the control group used the counselor-based system to 
select courses in the traditional manner. 

Three criterion measureB were used to assess the relative effectiveness 
of the cemputer-based system i test of students' understanding of information 
relevant to course selection; students' self-reported reaction to his experi- 
ence with the computer or counselor; and an evaluation of the completed student 
programs by five counselors who did not hnow which programs were produced oy 
student- computer interaction and which by student-counselor interaction. 

A slx-v;ay analysis of variance with repeated measures was used to inter- 
pret the data. Each measure had a linear transformation performed on it so 

7 



tll6i oGOr^:S "i-JOlllLri l’'»G i’n,bl.C> TilC 2]tJV; ll‘'^;!i L'lu:.^ j-tlu nl 

brciiif- boinnci * ■ i nn l’oi‘iTi?'ci oividln^^ encli o^'i/jiual r^rT'i'G C’i n itioArriiio 

by the square-root of the luean square error tor that measure Also, a four- 
v/ay complete^,;/ crossed multivariate analysis of variance was used to aiialyEe 
the data , This permitted the ^ nvestigator to interpi-ct the data from at 
least two different stati stical analj^ses . Of ma.yr concern was the comparison 
between computer-'aGsis ted and counselor-ass is tea couroe plniiriing^ but the 
effects of subjects' sexb grade level, and abilit:i were also tested as well as 
all interactions among variables. 



Fopulatlon 

Willowbroolc High School is a suburban, comprehensive high school located 
15 miles west of Chicago, with approximately 3^00 stude^nts. After hj gh school, 
Uf)% of its studerdos attend foui'-^year cclleges; fTfo attend the local community 
college; 25% go directly i.nto jobs without further training; and approximately 
IC^ attend technical and specialized schools . 



Sample 

The 197O-7I freshman, sophomore, and junior c?uasses v;ere divided into 
ability quartiles based on their composite grade equivalent score on the SDS 
Educational levelopment Series batte2*y. The battery coriiposlte was based on 
eight subscales (non-verbal, verbal, reading, English, math, science, the U.S*A* 
and solving everyday problems) in four tested areas (Abilities, Language Studies, 
Technical Studies and Social Studies). From each quartile in each of the three 



grade levels, two boys and two girls were randomly chosen for each of the two 
course-selection procedures. The result was a 2 x 3 ^ ^ 2 design with two 

observations randomly assigned to each cell. Thus, there were two treatment 
groups, three grade levels, four quartiles and two sexes* All of the students 
the sample were ’*computer-wise" due to their experience with vocational 
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c- xp 1 C3 1* a. t J- o n sel l p • E Q ell o o ui ^ I o r h a 
office. It is used on 'j. regular tas.is 
student's record or explore vocational 



s an TB¥x 22f'0 display terminal in his 
duriing CDunseiir*n sessions to I’ecall 
information i/'itii i;he sL-udeni. 



a 



Measures 

Throe measures were taMn to avaluate the relative erfecti veliees of the 

tviO eourse exploratloii and selection procedu-i’es . 

1. Information Test 

Immediately after the scheduling interview with the counselor or 
computer, each student was given a test to assess his knowledge of 
information relevant to making course selections. The test contained 
items to assess the student's knowledge of cuvricular offerings, 
prereciui sites, college requirements, etc. This test had a Kuder 
Richardson #20 reliability of .7^63 and a standara error of measurement 
equal to 1.7982 based on the first trial administration to thirty 
students. Revisions were made, based on the first administration, to 
have a more reliable instrument for use In the study. The revised 
information test had a Kuder Richardson #20 reliability of .?609 and a 
standard error of measurement equal to 1.9607 when administered to 
the ninety- six students taking the test in this study. 

2. Student Reaction Questionnaire 

Immediately after the scheduling interview with the counselor or 
computer, each student was asked to report his reaction to the inter- 
view. The questionnaire asked students to Indicate their degree of 
satisfaction with the courses selected, with the information provided, 
and with the way in which information was presented. This question- 
naire had a Hoyt reliability of .8395 and a standard error of measure- 
ment equal to 4.3638 based on the first trial administration to thirty 
students. Revisions were made to have a more reliable instrument for 
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use in the study. The revised questionnaire had a Hoyt reliaoixit^^ Oi. 
.850U and a standard error of measurement equal 1.-0 3*73*o3 °n 

the ninety-six students taking the test in this study. 

3 . Counselor's Ratings of Course Selections 

T'/velve counselors froui Willowtrook High School independently rated 
the appropriateness of the course selections for each of the ninety- 
six students without knowing the identify of the students and without 
knowing whether the selections were counselor-student or computer- 
student produced. The raters had aptitude, achteveTnent , interest, and 
career plan data on each student. For each of these four student 
characteristics, the raters indicated the appropriateness of the course 
selections on a five-point scale. Each student's course selection 
was rated by five different counselors. Each rater had an equal num- 
ber from each grade level and an equal number of computer- scheduled 
and counselor- scheduled students to rate. A Hoyt reliability was cal- 
culated for all of the ratings on all of the students. A reliability 
of .6615 and a standard error of measurement of 2.4033 was found for 
the sum of the counselor ratings. The sum of the ratings for each 
student was used as a dependent variable in the study. 



Treatment B 

As previously indicated^ each subject v/as randoinly assigned to one of the 
following two treatments in a manner to insure equal call frequency: 

1. Computer-Assisted Course Selection 

During the first week of February 1971 the students were given a 
registration guide for them to read before the scheduling interview. 
The students were then sent a note which indicated that it was time 
for them to register for their courses for the 1971-72 school year. 
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The students then nsade ail appointment to be scheduled v;ith u.lie 
assistance of the computer. 

A computer prograni developed by the Initiator of this study and the 
staff of V/illowbrooi-'; High School allovjed students to Interact viith 
the computer to select courses for the follovving year. The program 
helped the students consider the curricular alternative: in lignt of 

their interests, abilities, and previoiis course i^orK. Procedures uere 
developed vmich allowed each student to interact with the proga am 
through a visual display terminal. Selection of courses for these 
students v/ere made without the consultation of a counselor although 
counselors were avallahle suhsequently if the need occurred. After 
the student selected his courses the secretary checked the student's 
name against a list to determine If he was in the study. If he was 
in the study, he was then gli'-en the Information Test and the Reaction 
Questionnaire related to his scheduling interview. No mention was 
made to the student that this was a part of an experimental study. 

It was indicated to the student that this wa.s a part of the ongoing 
evaluation at Willowbrook. 

Counselor-Assisted Course Selection 

Students in this group selected courses In consultation with a coun- 
selor in the manner traditionally used at Willowbrook and in many 
other high schools. The students did not receive computer assistance. 
During the first week of Fehmiary 1971 the students were given a 
registration gu,ide for them to read before the scheduling Interview. 
The students were then sent a note which indicated that it was time 
for them to register for their courses for the 1971-72 school year. 

The students then made an appointment to see their counselor to select 
their courses. The counselors who assisted in scheduling students 
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their courses. 



dirl not know 



'.vhich students v,-ere in the study and which were not. 

The student, in an individual interview, talked over his career plans, 
his academic progress, and his performance on tests he had tauen that 
were assumed to be i’olated to his interests and future plans. This 
discusaion served as the basis for course selection. After the studenu 
selected the courses, the course uumbei's were entered for each student 
on a computer terminal by the counselor and the student was requested 
to go to tno oecretary and pick up a copy of his course select ?..ons 
for the following school year. At this time the secretary checked 
the student's name against a list to determine if he was in '-he study. 
If he was in the study, he was then given the Information Test and 
the Reaction Questionnaire related to his scheduling interview. Wo 
mention was made to the student that this was a part of an experimental 
study. It v/as indicated to the student tliat this vras a pait oi the 
ongoing evaluation at Willowbrook, 



Results 

It was of major concern as to whether there would be a difference based 
on all of the measures between those students seheduled with the assistance 
of a computer and those students scheduled with the assistance of a counselor. 
There were no dlffererices between either of the scheduling methods based on 
the appropriate statlsti can- mot.hods. The means for each of the treatment groups 
on each of the measures is Indicated in Table I. 





Ti^BLE I 



Treatment Means for Eacli Measure 
Using Transformed Scores'*^ 



Variable 


Co\u3selors ' 
Rating 


Information 

Test 


Students' 
React ioxi 


Overall 


Control 

(Counselor 

Pcheduled) 


4.4 


4.8 


6.2 


5 . 8** 


Experimental 

(Computer 

Scheduled) 


4.2 


4.9 


8.1 


5 . 1 ** 



»See page 8 for eitplanatioii of the linear transformation 

**Differences among means not signif:i cant, P5.05* 

The measures had the reliability to detect differences betueen grades, 

auartiles and males and females, but no differences uere found between the 

different scheduling methods . 

The students were asked to indicate their reaction to each meth 
scheduling. There were not any differences. The students liked the interacting 
with the computer as well as they liked interacting with the counselo . 

Those students In the upper and lower ability q.uartlles Ixked one method 

as well as the other scheduling method. 

One might have suspected differences between the reactions of the boys 

and the girls to the two course selection methods but there were none. 

The counselors rated those courses elected with the aid of a computer 
as high as those courses elected with the assistance of a counselor in an indi- 
vidual session. Also, the students had STual means on the Information test 
given to them after their scheduling interview with either the computer or the 
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counselor. 



Summary 



Thore hav'- beien sevei-al faars 
not be as effective as counselors. 



expressed indicating tlint teclmolngy could 
Some concerns ares related, to the "dohuman- 



izino" procesc of using man and machine Interaction; upper puartile studencs 
would, get bored; lov/er quart ile students would not understand; and programing 
could not be individualized. None of these fears seem to be valid cased on 
this study. A variety of independent mo.asurcs were used in attempting to 
determine if the results from the two methods of helping students explore and 
select cour.ses on the secondary level were different. 

Because of the efficiency of the eornpute.r and the ability to save the 
counselor time needed to disseriiinate infoi-mation about courses , there is no 
basis for VJillowbrook to discontinue using the computer to assist students in 
the exploration and selection of coursas for the lollowing school yeai . 

The implications of this study must be Interpreted in terms of the popu- 
lation sampled and the aiaterials employed to measure the differences between 
treatments. Alsoj one should consider the measures in terms of their appro- 
priatenes.s to distinguish between those important characteristiGS rilai d to 
the desired outcomes for a course exploration and selection method. 



It Is continuously important, both on a short and long range basis, to 
evaluate the implications of counseling and its effect on students. It is 
certainly advisable to consider the role of counselors and how they can be 
most effective in serving students at the secondary level. With the invention 
and growth of technology related to counseling it is certainly possible that 
many of the information disseminating and processing tasks that counselors do 
could be done more effectively and efficiently by technology. The variables 



of grade, ability, and sex seem to be important in effecting how decisions are 
made. The amount of information that one needs at a given time is relative to 
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his future plans, abilities anl achtovernGnt. 

This stiiciy dernorj^trated th-’ ased on the measures used, with the popula^- 
tioii sainpled, that the counselors T.^ere no more effective than tho computers in 
assisting the students to explru'e and select courses on the sec'^r.dary level 
for the following school year. It is important to continue to evaluate this 
process to determine if technology can be as effective as counselors in certa.n 
kinds of tasks vni.th certain populationE v;hlch are* currently being done by 
couuselors . 
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